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Description 
Structural Integrity Monitor 

Cross Reference To Related Applications 

[0001] This application claims the benefit of U.S. Provisional Ap- 
plication Ser. No. 60/481,123 filed July 22 2003. 
Background of Invention 

[0002] The method of the present invention belongs to area of 
nondestructive testing (NDT). Contrary to common prac- 
tice this method implies completely passive monitoring 
technique. Mostly modern NDT technologies employ ac- 
tive methods of interaction with the test subject that em- 
ploy external sources of test substances or other distor- 
tions. The most common of them are: Visual inspection; 
Liquid penetrant; Acoustic emission; Eddy current; Ultra- 
sonics; Radiography; Magnetic particles; Acousto-pho- 
tonic. 

[0003] Out of these technologies Visual inspection and Liquid 
penetrant are the most difficult ones, which require sig- 
nificant manual labor. 


[0004] Acoustic emission (AE) is the most popular teclinology on 
today's marl<et. It allows efficient automation of testing 
and centralized access to information. The core phe- 
nomenon for this technique is emission of ultrasonic 
wideband sound at moments of defects formations. Suc- 
cessful acquisition of these sounds and following sophis- 
ticated analysis allows pinpoint accuracy in defect detec- 
tion. Main and fundamental disadvantage of AE is inability 
to identify defect that already occurred. This imposes re- 
quirements of continuous and uninterruptible monitoring, 
which makes AE less robust and more vulnerable due to 
excessive weight and power losses. In addition fracture 
analysis is only as good as analytical software that is used, 
and may cause insignificant defects to trigger alarm of 
structural integrity breach. 

[0005] Eddy current technology is limited to conductive materi- 
als. Originally it was used as test and not monitoring 
technique due to physical requirements of the sensors. 
Recently, advances in this technology extend it to meth- 
ods of remote monitoring. 

[0006] Ultrasonics is based on active scan of a system using 
source of ultrasound waves. This technology has been 
mostly replaced by AE. One of the reason for drop in its 


popularity is complexity of this technique that required 
considerable technical training and skills. 

[0007] Radiography uses penetrating radiation to examine struc- 
ture of a system. Method is very similar to visual inspec- 
tion and also imposes limitations on set of equipment that 
can withstand the radiation. This technique is time con- 
suming and can only be used for testing. 

[0008] |\/iagnetic particles inspection technology allows finding 
flaws on and near surface in ferromagnetic materials such 
as steel and iron. It is very sensitive to surface irregulari- 
ties and scratches and requires careful surface prepara- 
tion. This limitation makes this technique applicable to 
very narrow set of tasks. 

[0009] Acousto-photonic technology is recently emerged. It 

combines ultrasonic inspection technology with advances 
of scanning laser vibrometry and computer analysis. This 
technology has highest price tag on the market and of- 
fered by Honeywell Corporation. Due to its price and com- 
plexity it is affordable to very small group of customers. 

[0010] The method of the present invention uses sophisticated 
automated analysis of data from passive sensors that 
gives the method significant advantages over other pas- 
sive techniques that rely on manual work. The absence of 


energy emitting components in implementations of the 
method allows significant increase in its reliability and 
lowers power utilization. That makes its implementations 
more competitive in size and weight as well. 
[0011] The method of the invention provides continuous moni- 
toring similar to AE., but effect of power failure or even 
complete disconnect does not invalidate structural in- 
tegrity status, which makes the method of the invention 

more robust. 
Summary of Invention 

[0012] This invention discloses novel method and apparatus that 
allow continuous monitoring of structural integrity of 
components and assemblies at relatively low cost. The ap- 
paratus is highly autonomic and low weight that permits 
its use on variety of systems and components. 

[0013] The method of the invention belongs to NDT techniques. 
It uses single or plurality of passive sensors at least some 
of which are capable of providing time variable response. 
The primary idea of the method is the use of variable plu- 
rality of unknown external and/or internal distortions ap- 
plied to the subject of monitoring. These distortions act 
as a source of test signals that are registered by attached 
sensors. All known NDT approaches rely on know sources 


of test signals or monitor just particular critical events as 
in case of AE testing. 

[0014] The method disclosed in the present invention does not 
rely on such events but instead determines structural in- 
tegrity of the subject by testing its integral pattern of sen- 
sor's signals on compliance with a priory found pattern 
characteristics. The set of such characteristics can be es- 
tablished once or can be dynamically build and/or ad- 
justed continuously or periodically. 

[0015] Another benefit of the method is its ability to use low cost 
sensors, it can be sorely based on the use of slow re- 
sponse low bandwidth acoustical, thermal, pressure, etc 

sensors. 
Brief Description of Drawings 

[0016] Fig. 1 shows example of activity model associated with 

the method of the invention. 
[0017] Fig. 2 shows example of isolated node linked to multiple 

passive sensors. 
[0018] Fig. 3 shows a version of block diagram for profiling of 

the system using simple autocorrelation filter. 

[0019] Fig. 4 shows two examples of implementation algorithms 

for the network of monitoring nodes. 
Detailed Description 


Method 


[0020] The method of the invention uses concept of LTI (linear 
time invariant) system with steady states. Structural in- 
tegrity of such systems is one of possible applications of 
the method. The method is based on use of only passive 
detection techniques and it collects data from single or 
multiple passive sensors that report momentary values of 
distortions propagating through the system. The sources 
of these distortions are events external to the subject of 
the invention and the use of the present invention is not 
bound to them. Examples of the sensors are temperature, 
acoustic, voltage, current, resistance, deformation, pres- 
sure, photo, flow rate etc. The sensors can be homoge- 
neous and measure only single type of distortions, or het- 
erogeneous and measure some combination of different 
distortion types. 

[0021] Fig. 1 shows one of possible implementations of activity 
model associated with this method. The method uses ma- 
trix of time series in frequency domain as a representation 
of current status of monitoring system. Gradual evolution 
of coefficients of this matrix corresponds to aging process 
of the system and abrupt changes correspond to events of 
structural changes. While normal structural changes are 


considered recurrent events of nominal operation of tlie 
system their projection on said matrix exists in two forms. 
Stateful changes create additional partitions or instances 
of said matrix, while small, fast or stateless changes affect 
characteristics of its coefficients by increasing their vari- 
ance. 

[0022] jhe values of acceptable coefficients are limited by preset 
collection of constraints. Runtime version of this matrix(s) 
has value different from one previously evaluated. The 
changes within the constrained region of functional space 
are considered acceptable, while the rest of the changes 
indicate abnormal change of structural integrity of the 
system. 

[0023] Fig. 1 diagram shows time series of sensor data that ac- 
quired (10) and a set of proposed characteristics (11) 
computed for them. In case of multiple time series these 
characteristics form proposed Integrity matrix (12). The 
subject of the test/monitoring at some moment has to be 
present at a state of known integrity (13). Example of such 
state is "normal operational" when it is known that the 
subject remains in desirable conditions. This state is 
called Valid state (13). In valid state the set of proposed 
characteristics and or proposed Integrity matrix are used 


to update Valid Characteristics (14) of tlie subject. Wlien 
tlie state of the subject needs to be determined the sub- 
ject is present in Unlcnown state (15). The state validation 
occurs by comparison (16) of the proposed characteristics 
and or Integrity matrix versus Valid characteristics. When 
these two sets does not match within imposed con- 
straints, the Unknown state is treated as invalid and In- 
tegrity failure (17) processing begins. 
[0024] Following mathematical worksheet illustrates mathemati- 
cal approach for described method that can be employed 
to compute Integrity matrix in designs that employ multi- 
ple sources of sensors signal. To simplify its understand- 
ing some details are skipped. Steady state scenario uses 
the same approach that results in partitioned matrix or a 
collection of matrixes where each matrix is linked to indi- 
vidual state. It is assumed that current state of the subject 
is Valid. This assumption is tested if previously known 
valid state exists, or is taken by default if no prior data 
exists. It is also assumed that the length of time series 
that represent sensors signals is sufficient to average 
stochastic components in those signals. 


LTI system defined by infinetely dimensional space G of matrixes g. 

s(o=gi®«;(o (100) 

, where 

s(t) is vector of sensor readings, 

f(t) is vector of unknown stimuluses, and 

/' G [O, oo)for complete functional space P of stimuluses. 

Space P is defined through complete set of locations and 

types of external and internal distorsions appliable to the system. 

Functional space K superseeds P by addition of functional space of sensor readings : 

K = P^S 

Functional vectors in space K constructed as 


/o 


, where n is number of sensors attached to the system. 


The same system will remain LTI when considered in space Q of matrixes 
s(0 = qj®k,(0 (200) 

Space of rectangular matrixes Qj has invariant square minor of rank n 
It can be found from equation 200 as 
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[0025] Matrix M remains constant within preset constraints wliile 
structure of the system remains unaltered. Coefficients of 
the matrix can be found from equation shown on next 
mathematical worksheet: 


F(s(/)) = F(m)F(s(0) ^ 

S = MS (300), 

where F is Fourier transform 

[0026] Each row of the matrix Mcontains n-1 unknown complex 

2 

functions. In order to find all n -n unknown coefficients of 
the matrix at least n-1 distinct distortions have to be reg- 
istered by the sensors. The time span of the registration 
defines spectral range of the matrix Mand repetitive dis- 
tortions increase precision of the matrix coefficients. Each 
coefficient in the matrix Mis obtained as an average 
across all solutions of equation (300) found over specific 
period of time. Each of the coefficients can be stored as a 
combination of vectors of its average and variance. 

[0027] stateful transitions of the system results in statistically 
significant clustering of coefficients of the matrix. This 
clustering is used to create separate partition in the ma- 
trix or in some cases separate version of said matrix as- 
sociated with particular steady state. 

[0028] Matrix Mallows efficient solution in cases of multiple sen- 


sors. In case of single channel designs the convolution 
operator has limited use. More efficient approach for this 
case is a use of preset filters. Autocorrelation, self convo- 
lution in Fourier space, match-filtering are just some ex- 
amples of such filters. The role of the filter is to discover 
nonrandom characteristics in plurality of sensor data sets. 
For one experienced in art of digital filters and signal pro- 
cessing it is obvious that plurality of standard algorithms 
can be used in this method, as well as custom filters can 
be constructed to suite special design tasks. 

[0029] Results of these filters across plurality of valid datasets 

are analyzed on presence of clusters and each cluster cre- 
ates separate partition in space of detected Characteris- 
tics. Each partition contains a set of Characteristics asso- 
ciated with specific cluster. In consideration of steady- 
state model each cluster may represent separate state. 

[0030] In order to validate current integrity state of the subject 
its sensors needs to be pooled and a new set of charac- 
teristics and or matrix to be computed. Their values are 
compared versus all partitions of the characteristics sets 
and or the matrixes. If matching partition exists the cur- 
rent integrity state of the subject is valid, and newly 
polled datasets can be merged with matching partition. 


[0031] For one experience in the art of software development and 
signal processing it is obvious that variety of alternative 
algorithms can be chosen to implement disclosed idea. 
The method disclosed in this invention does not intend to 
limit this idea to one example implementation and only 
serves as an example to illustrate the primary subject of 
the invention. It is also obvious that method can be opti- 
mized for various hardware implementations and can use 
sequential, parallel, incremental, recursive and plurality of 

other alternatives. 
Algorithm 

[0032] Algorithm that illustrates the method of this invention op- 
erates in one of the following modes: 

[0033] Perform initial profiling of the system that involves: 1) pe- 
riodic or non-periodic acquisition of all sensor channels 
over some time period; 2) computation of structural In- 
tegrity matrix M and/or persistent Characteristics, stan- 
dard sensor noise level and achievable detection speed. 
Detection speed or timing depends on multiple factors 
such as reliability and quality of sensors, average level of 
standard distortions and their types, physical properties 
of the system. Long timing indicates that structural in- 
tegrity alert signal will be raised with significant delay af- 


ter structural integrity of tlie system being affected. The 
term initial only indicates that the subject system is con- 
sidered to be in Valid state. The profiling can be per- 
formed at any time the state of the system is Valid. 

[0034] Validate integrity acceptance constrains, which may in- 
clude constraints for slow age related structural degrada- 
tion, maximum and minimum magnitudes of distortions, 
acceptable level of abrupt change of structural matrix, 
minimum allowable number of functional sensor channels, 
etc. It is possible to consider scenario when some of the 
sensors fail and reduced subset of Characteristics is used 
to continue monitoring of the system. 

[0035] Perform continuous profiling of the system by refining 
structural integrity matrix. This continuous refinement 
causes elements of the matrix converge to the mean val- 
ues and standard deviations to their minimum. Statisti- 
cally significant change in the sensor data (e.g. computed 
as T-test) is analyzed vs. established constraints . This 
mode of operation also may include status reporting or 
update which consists of active communication between 
the monitoring system and other functional elements, and 
may rise preliminary warnings and alerts indicating signif- 
icant structural changes in the system that are still within 


allowable range. 
[0036] Switch to standby or hibernation mode that allow system 
to remain inactive and reduce or eliminate power con- 
sumption while integrity monitoring is not required. This 
mode can be actively used by the system when level of re- 
ceivable distortions falls below established detection 
threshold. 

[0037] Switch to monitoring mode and perform comparison of 
current structural Integrity matrix and or persistent Char- 
acteristics versus Valid Characteristics and accepted 
change trends. This mode of operation also may include 
status reporting or update which consists of active com- 
munication between the monitoring system and other 
functional elements, and may rise preliminary warnings 
and alerts indicating significant structural changes in the 
system that are still within allowable range. 

[0038] Switch to alert mode and rise integrity degradation signal 
when current Characteristics does not fit into allowable 
constrained functional space or any other constrains are 
violated. This mode can be reset manually or automati- 
cally and initial profiling of the system executed. 
Apparatus 

[0039] Fig. 2 shows schematic of basic node of the invented ap- 


paratus. A network of the nodes can form very sophisti- 
cated structural integrity monitoring systems. Component 
or system 100 that needs to be monitored equipped with 
plurality of sensors 101 that linked with the apparatus 
200 that formed by plurality of nodes. As an example 
thermal and acoustical sensors with optical transducers 
are shown. It was previously described, the types of sen- 
sors may vary as well as any number of redundant sensors 
can be used. Lower part of the picture shows these sen- 
sors connected through optical or electrical busses 102 to 
signal converter/amplifier 103 which transforms all sen- 
sor outputs to the same form. These signals are further 
converted into digital form by converted 104, which may 
be integrated into processing module 105. Processing 
module 105 executes all methods and algorithms de- 
scribed in the previous sections and can be implemented 
as a digital microcontroller, DSP, generic processor, com- 
puter, optical computer or any other means capable of 
performing the method of the invention. 
[0040] It is obvious that with current level of development of in- 
tegral electronic/optical components the unit 102/200 
can satisfy any interface requirements necessary for com- 
munications with various types of external digital and 


analog equipment. 

[0041] Example 1 

[0042] Simplest implementation of described apparatus can be il- 
lustrated on example of single sensor channel attached to 
complex body, the structural integrity of which needs to 
be monitored. Examples of such body are: passive struc- 
ture like building, combustion engine, rail beam, etc. 
Where in said sensor may acquire acoustic vibrations, or 
thermal variations, or other distortions. Acquired signal 
from the sensor has limited bandwidth with fixed low and 
upper cut-off frequencies. The sensor is attached through 
ADC converter to notebook computer that performs func- 
tions of controller by executing user-level code. 

[0043] Initial profiling of the system illustrated on Fig. 3. It uses 
normal set of disturbances (30) the body is subject to 
during normal use. Data series s^from sensor processed 
using predefined set of custom filter functions. As a trivial 
example consider scenario that uses single circular auto- 
correlation filter (31) applied to the phase of FFT trans- 
form of each captured dataset. Output from the filter con- 
tains lag series f ^(32). It is assumed also that during ini- 
tial profiling integrity of the body does not deteriorate. 
The lag series merge into family (34) of populations P , 


where n- represents the lag value. Each population (33) 
represented as average and variance of filter output for 
specific lag. 

[0044] Profiling process is always treated as static stochastic 

process regardless of type of disturbances. This assump- 
tion is true even in the case when the process have multi- 
ple states. Each population P checked on presence of 

n 

significantly separated clusters (35) using one of standard 
statistical approaches. In this example paired student T- 
test is employed to find the clusters. This process results 
in collection of P ^populations (36), where c-is identifier 

n 

for specific state/cluster. 
[0045] Predefined acceptance constraints then applied on these 
populations to filter out all collections that do not satisfy 

the constraints. In this example trivial constraint C is 

^ 0 

used that places a limit on maximal relative standard de- 
viation. In generic case such constraint should be used in 
combination with other constraints. Herein to simplify the 
example this constraint is set along that results in final 
set F of populations P ^. 

n 

[0046] The trivial case of implementation does not allow incre- 
mental or continuously adjustable profiling, so when ini- 
tial profiling process completes, the process of strict 


monitoring starts. Sensor continues to produce data series 
that processed by the same filter function. Results of the 
filter checked against static set F and confidence intervals 
are computed to validate match of the results to each P ^ 

n 

m 

[0047] Aging of the body or its direct damage causes failure of 
specified test which results in positive integrity failure 
signal. 

[0048] Example 2 

[0049] Following are examples of standard filters used in conver- 
sion of single sensor signal: autocorrelation of signal, au- 
tocorrelation of power spectrum of the signal, cross- 
correlation of sequential signal datasets, cross-correlation 
of rows in accumulated table of datasets, custom match- 
filtering, etc. Requirements and resources for each type of 
filter vary that allows in each particular implementation 
use only small number of most suitable filters. 

[0050] Example 3 

[0051] In example 1 the method implementation was restricted 
to case of negative identification, that means only missed 
characteristic were used to trigger an alarm. In broader 
case the method implies dynamic profiling of the body. As 


a result of such profiling new characteristics can be added 
to system identification set in a way that prior characteris- 
tics do not change. 

[0052] This type of positive identification in many practical cases 
can be treated as a potential safety warning. Example of 
such scenario is unexpected consistent water leak. While 
no direct structural degradation occurred, the leak creates 
new consistent nonrandom signal pattern, which creates 
new characteristics for the system in dynamic profiling of 
the body. It is useful to allow the method to report such 
change as a warning. 

[0053] Another example of positive identification is appearance 
of new low variance Characteristics. Such example com- 
prises a case of spinning fan that suddenly stops. Noise 
from the fan prevented some Characteristics of the system 

to be accepted due to constraint C . Reduction of distur- 
^ 0 

bances caused by stalled fan allows those characteristics 
to be included, and indicate potential Integrity degrada- 
tion of the system. 
Structural Integrity Network 

[0054] The invention discloses method and apparatus of building 
complex systems containing multiple components and or 
subsystems equipped with structural integrity apparatuses 


and or networks described in tiiis invention. Eacli compo- 
nent or subsystems equipped witli structural integrity ap- 
paratus or structural integrity network is defined as a 
node. Nodes are connected through parallel or serial com- 
munication channels, wherein the channel may be estab- 
lished statically or dynamically and be implemented as 
wireless or physical connection. Each node is capable of 
sharing sensors readings in raw or processed form as well 
as elements of the structural Integrity matrix M and/or 
persistent Characteristics. 
[0055] Structural matrix of a system containing multiple nodes is 
shown on mathematical workout sheet: 

^22 M, 


, when i=j the minor M is structural matrix of an individ- 

U 

ual node, for z>j a new minor M is computed using sen- 

ij 

sors readings of both node zand node j. 
[0056] Structural matrix of the system or the network has rank 


M 

system 


M 


21 


not exceeding sum of ranks of all nodes which it com- 
posed of. In practical applications structural matrix of the 
network can be selected to have smaller rank by exclusion 
rows and columns with high variance or narrow frequency 
spectrum. 

[0057] Such selection can also be dictated by type of the nodes. 
Fig. 4 shows two examples of implementation algorithms 
for the network. 

[0058] Nodes of type 110 does not have capabilities to receive 
external sensor data due to limitation of their processor 
resources, they form tree-like network by means of hubs 
111 that receive sensor data from several nodes and per- 
form computation of sub-system structural matrixes us- 
ing the method of the invention, and monitor integrity of 
the system part that associated with linked nodes. 

[0059] In some implementations nodes of type 110 does not 
have processing capabilities and only capable of initial 
conditioning of the signals and transmitting their data to 
other node types. 

[0060] Nodes of type 112 have enhanced processing capabilities 
and are capable of processing data from sensors of own 
node as well as compute sub-system structural matrixes 
using data from other nodes. 


[0061] Topology of these networks allows incremental addition of 
components to the system. A resulting system has built-in 
expandable and scalable structural integrity monitoring 
capabilities. 

[0062] These networks can be connected to other types of infor- 
mation networks and or communication means. Some ex- 
ample of those are Internet, Telephone, Cellular, wireless 
networks. Due to low bandwidth nature of the signals 
from the sensors, analysis and processing of the data can 
be hosted in remote processing nodes. This way complex- 
ity and cost of implementation of the method can be re- 
duced even more. 

[0063] Complex subjects or subjects with large geometrical/ge- 
ographical dimensions may implement the method by 
means of communication through public or private infor- 
mation network. Processing nodes of type 111 or 112 may 
be employed to discover persistent signal Characteristics 
that associated with remotely located nodes. Examples of 
such implementations: bridges, stationary platforms, land 
masses. In case of land masses the some apparatuses of 
the invention my be placed on mountain ridge while oth- 
ers buried near a shore line. Nodes in mountain locations 
can be linked to public telephone network through cellular 


connections to nearest tower, while nodes on shore line 
can be directly connected to telephone lines. This way 
processing nodes can located anywhere on earth. Viola- 
tion of the persistent Characteristics in the pattern of the 
signals and invalidation of structural integrity in such sys- 
tem my be an indication of approaching landslide, earth- 
quake, or some other major events. 
[0064] Dye to high energy efficiency the nodes of type 110 can 
utilize renewable power sources or even accumulate en- 
ergy form connected signal networks. 
Applications 

[0065] The method and its implementations disclosed in this 

document in addition to NDT allows to extend it applica- 
tions to areas outside of NDT domain. In previous sections 
of this invention it was shown that the method can be 
used to monitor normal operations of complex systems 
and report their partial/complete malfunctions, that are 
not caused by structural degradation. 

[0066] The method allows extension of its analysis to powerful 
and or external processing nodes that are capable of per- 
forming forecasting structural failures and or malfunc- 
tions. 

[0067] It is obvious to one experience in the art that the method 


and apparatuses of the invention can be implemented to 
provide NDT and malfunction monitoring for static struc- 
tures, vehicles, marine structures and marine vehicles, 
aircrafts, spacecrafts and space based structures, geologi- 
cal structures such as mines, gas deposits, oil deposits, 
large land masses, etc. 
[0068] In some implementations the method can be used to re- 
port not only failure or degradation of structural and 
functional characteristics but also unusual usage events 
and or patterns, that in some cases can also be used for 
security purposes. Example of such implementation can 
be acoustic sensor located inside the building that detects 
alteration in acoustic reverb of the room caused by open 
door at unusual daytime. 


